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Abstract 

We study the stable behaviour of discrete dynamical systems where 
the map is convex and monotone with respect to the standard positive 
cone. The notion of tangential stability for fixed points and periodic 
points is introduced, which is weaker than Lyapunov stability. Among 
others we show that the set of tangentially stable fixed points is iso- 
morphic to a convex inf-semilattice, and a criterion is given for the 
existence of a unique tangentially stable fixed point. We also show 
that periods of tangentially stable periodic points are orders of permu- 
tations on n letters, where n is the dimension of the underlying space, 
and a sufficient condition for global convergence to periodic orbits is 
presented. 

*The first two authors were supported by the Arpege programme of the French National 
Agency of Research (ANR), project "ASOPT", number ANR-08-SEGI-005 and by the 
Digiteo project DIM08 "PASO" number 3389. 
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1 Introduction 



Many natural dynamical systems preserve a type of ordering on the state 
space. Such dynamical systems are called monotone and often display rather 
simple behaviour. In the last couple of decades monotone dynamical sys- 
tems have been studied intensively, see [15] for an up-to-date survey. Ground 
breaking work on monotone dynamical systems was done by Hirsch [13\ [T3] , 
who showed, among others, that in a continuous time strongly monotone 
dynamical system almost all pre-compact orbits converge to the set of equi- 
librium points. In a discrete time strongly monotone dynamical system one 
has generic convergence to periodic orbits under appropriate conditions on 
the map, see [9l [121 121] • Various additional conditions have been studied 
to obtain convergence of all orbits instead of almost all orbits. A type of 
concavity condition, also called sub-homogeneity, has received a great deal 
of attention, see [21 [16l [191 [301 [31] . The concavity condition makes the dy- 
namical system non-expansive, which allows one to prove strikingly detailed 
results concerning their behaviour. 

In this paper we study discrete time dynamical systems 

= /(x*^) for A: = 0,1,2,... , (1) 

where f : T> ^ T> is a, convex monotone map on P C R" preserving the 
partial ordering induced by the standard positive cone. Such dynamical 
systems are in general not non-expansive. We introduce the notion of tan- 
gential stability for fixed points and periodic points, which is weaker than 
Lyapunov stability. It turns out that this notion is the right one to prove a 
variety of results concerning the stable behaviour of monotone convex dy- 
namical systems, which are of comparable detail as the ones for monotone 
non-expansive dynamical systems. 

In particular, we show that the tangentially stable fixed point set is 
isomorphic to a convex inf-semilattice in M". We also give a criterion for 
the existence of a unique tangentially stable fixed point. In addition, tan- 
gentially stable periodic orbits are analysed and a condition is presented 
under which there is global convergence to Lyapunov stable periodic orbits. 
Among others it is shown that the periods of tangentially stable periodic 
points divide the cyclicity of the critical graph, which implies that the peri- 
ods are orders of permutations on n letters. However, the periods of unstable 
periodic orbits can be arbitrary large. 

The results are a continuation of [1] in which the first two authors stud- 
ied discrete time dynamical systems ([T|), where /: M" is not only 
convex and monotone, but also additively sub-homogeneous. The extra 
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sub-homogeneity condition makes the dynamical system non-expansive un- 
der the sup-norm [8]. The non-expansiveness property severely constrains 
the complexity of its behaviour |18^ [22] and makes all fixed points and pe- 
riodic orbits Lyapunov stable. It also ensures that the subdifferential of 
/ at a fixed point consists of row-stochastic matrices. Without the addi- 
tively homogeneity condition, the subdifferential merely consists of stable 
nonnegative matrices, which makes the analysis more subtle. 

Motivating examples of discrete convex monotone dynamical systems 
arise in Markov decision processes and game theory as value iteration schemes, 
see [U and the references therein. The results in this paper extend results 
for Markov decision processes with sub-stochastic transition matrices to ar- 
bitrary nonnegative matrices. In particular, they apply to Markov decision 
processes with negative discount rates, see [28]. Discrete convex monotone 
dynamical systems are also used in static analysis of programs by abstract 
interpretation [7], i.e., automatic verification of variables in computer pro- 
grams. They also appear in the theory of discrete event systems 0], statis- 
tical mechanics [23] , and in the analysis of imprecise Markov chains [10] . At 
the end of Section 2 we give several explicit examples. 

The paper contains nine sections. In Section 2 several basic definitions 
and properties of convex monotone maps are collected. Subsequently various 
degrees of stability of fixed points of convex monotone maps are discussed 
and the notion of tangential stability is introduced. In Section 4 several pre- 
liminary results concerning stable nonnegative matrices are given. Among 
others rectangular sets of stable nonnegative matrices are studied. In Section 
5 we analyse tangentially stable fixed points and introduce the critical graph 
of a monotone convex map. Section 6 is used to collect several preliminary 
results concerning convex monotone positively homogeneous maps that are 
needed in the analysis of the geometry of the tangentially stable fixed point 
set. Section 7 contains the main result on the geometry of the tangentially 
stable fixed point set. Section 8 concerns tangentially stable periodic points 
and their periods. In the final section a criterion is given under which each 
orbit of a discrete time convex monotone dynamical systems converges to a 
Lyapunov stable periodic orbit. 

2 Basic properties of convex monotone maps 

Let = {x € M" '■ Xi >0 for 1 < z < n} denote the standard positive cone. 
The cone induces a partial ordering on M" by x < y if y — a: G M" . We 
write x ^ y if y — X is in the interior of W^j_. In particular, we say that x is 
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positive if <^ X. For x, y € M" we also use the notation x > y and x ^ y 
with the obvious interpretation. A set X C M" is caned bounded from above 
if there exists u G such that x < u for all x & X. Similarly, we say that 
X C R" is bounded from below if there exists I € such that I < x for all 
X ^ X. The partially ordered vector space (M", <) is a vector lattice, where 
the binary relations A and V are defined as follows. For x,y G (]R",<), 
X /\y \s the greatest lower bound of x and y, so (x A y)i = minjxj, yi} for 
1 < i < n, and x\Jy is least upper bound of x and y, so {x\Jy)i = max{x.j, yi} 
for 1 < z < n. 

A map f : T> ^ M", where P C M™, is called monotone if for each 
x,y ^ D with x < y we have that /(x) < /(y). It is called strongly monotone 
if X < y and x ^ y implies that f{x) <C /(y)- A map f : T> ^ M", where 
P C M™ is convex, is called convex if 

/(Ax + (1 - \)y) < \f{x) + (1 - A)/(y) for ah < A < 1 and x,y eV. 

In other words, f : D ^ M" is convex if each coordinate function is convex 
in the usual sense. The reader may note that our notion of monotonicity is 
different from the one commonly used in convex analysis |25j . 

The orbit of x S P under a map f ■ "D — )> P is given by 0{x;f) = 
{/''(x) : A: = 0, 1, 2, . . .}. We say that x € P is a periodic point of f: V ^ V 
if /^(x) = X for some integer p > 1, and the minimal such p > 1 is called 
the period of x under /. 

Let A4m,n denote the set of all m x n real matrices, and let Vm,n be 
the set of all nonnegative matrices in Aim,n- A matrix P G Vm,n is called 
positive if pij > for all 1 < i < m and 1 < j < n. Given a matrix 
M e M m,n we denote its rows by Mi, . . . ,Mrn € -M-i^m and we identify 
M with the m-tuple (Mi, ... , M„,). So, M m.n is identified with the m-fold 
direct product 

Mm,n = Ml,n X ... X Ml^n- 

We say that TZ C A4m,n is rectangular if TZ can be written as 7^ = TZi x . . . x 
TZm, where TZi, . . . ,TZm are non-empty subsets of A4i,n- Furthermore it is 
convenient to introduce the following matrix notation. Given M G A4m,n, 
I C {!,..., m}, and J C {1, . . . , n} we write M/j to denote the |/| x \ J\ 
sub-matrix of M with row indices in / and column indices in J. Likewise, 
given X G R" and K C {1, . . . , n} we write xk G to denote the vector 
in obtained by restricting x to its coordinates in K. 

For a convex map f : D ^ R", where "D C R'" is open and convex, the 
subdifferential of f at v ^ D is defined by, 

df{v) = {M G Mm,n ■■ f{x) - f{v) > M(x - v) for aU x G V}. (2) 
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In the following proposition several basic facts concerning the subdifferential 
are collected, cf. [251 Theorem 23.4]. 

Proposition 2.1. If f is a convex map from an open convex subset V C R"^ 
to M", then for each v ^ T>, the set df{v) is non-empty, compact, convex 
and rectangular. 

We note that the rectangularity of df{v) follows directly from the fact 
that f{x) — f{v) > M{x — v) is equivalent to fi{x) — fi{v) > Mi[x — v) for 
all 1 < i < m. If, in addition, the map is monotone, then df{v) consists of 
nonnegative matrices as the following proposition shows. 

Proposition 2.2. If f : T> ^ M", where T> C is open and convex, is a 
convex monotone map, then df{v) C Vm,n for all v ^T>. Moreover, if f is 
strongly monotone, then each P € df{v) is positive. 

Proof. If V T>, then there exists U open neighbourhood of such that 

V — u T> for all u & U. Now if n > 0, with u € U, and P € df{v), then 
> f{v — u) — f[v) > —Pu, as / is monotone. Thus, Px > for all x € M" 
and hence P G 'Pm,n- We note that if / is strongly monotone, u > and 
u ^ 0, then ^ f{v — u) — f{v) > —Pu. This implies that Px ^ for all 
X € M" \ {0} and therefore P is positive. □ 

For a convex map /:!)—)• M", where T> C is open and convex, and 

V € V, the one-sided directional derivative of f at v is given by, 

= + (3) 

The map : M™" is well-defined, convex, finite valued and positively 

homogeneous, meaning that f^{Xx) = A/^(x) for all A > and x € M™, see 
[25\ Theorem 23.1]. Moreover, is monotone (because it is defined as a 
pointwise limit of monotone maps). We shall occasionally need the following 
representation of : 

fUy)= sup Py for yGM™ (4) 

(see [251 Theorem 23.4]). If /: V ^ V, where V C M"- is open and convex, 
then for each v T> we also have that 

iK)'' = f'fh~^{v) ° • • • ° f'f(v) ° fv 

(see [H Lemma 4.3]). 

Throughout the remainder of the exposition we shall make the following 
assumption on the domain of convex monotone maps / : D ^ D. 
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Hypothesis 2.3. The set V C R" is open and convex. 

Although in some results more general domains can be treated, we re- 
strict ourselves to this it simplifies the presentation. 

To conclude this section we briefly discuss several examples of convex 
monotone maps. In the theory of Markov decision processes one considers 
monotone convex maps / : M" — ?> M" of the form: 

fi{x) = sup rj+p'-x for i = 1, . . . , n. (5) 

Here r| G M and is a sub-stochastic vector for each j € Ai. The results 
in this paper apply to the case where is merely a nonnegative vector. 

Other examples arise in the study of systems of polynomial equations, 
X = P{x), where P = {Pi, . . . , Pn) and each Pi is a polynomial with variables 
xi, . . . ,Xn and nonnegative coefficients. Looking for a positive solution of 
X = P{x) is equivalent to finding a fixed point of the map f{x) = Log o 
PoExp, where Exp(xi, . . . , Xn) = (e^S • • • , e^") and Log denotes its inverse. 
We can write Pi{x) = J^jeAi ^ij^'' ^ where Ai C N" is a finite set and each 
Uij > 0, with the convention that x^ = x-[^ ■ ■ ■ x-'n for j = (ji, . . . , jn) € W^. 
Then 

fi{x) = log(^ Oij exp(j • x)). (6) 

Such "log-exp" functions are not only monotone, but also convex, see 
Example 2.16]. More generally, we could allow Ai to be a subset M" , instead 
of N". This yields a class of functions Pi which are usually called posynomials 
[6]. Posynonmials play a role in static analysis of programs by abstract 
interpretation |7]. Note that the example in ([5]) can be obtained as a limit 
of posynomials by setting Oij = e^'''^ and 

/f (x) := r'log(5^ exp(/3(r^' + pi ■ x))). 
If /3 tends to +cx3, then converges to the map ([5]), see [32] . 

3 Stability of fixed points 

Recall that a fixed point v D f : V ^ V is Lyapunov stable if for each 
neighbourhood U of v, there exists a neighbourhood V Q "D oi v such that 
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u € V and /'^(V) C U for all /c > 1. An n x n matrix P is called stable if all 
the orbits of P are bounded. Stable matrices have the following well-known 
characterizations. 

Proposition 3.1. For a matrix P the following assertions are equivalent: 
(i) P is stable. 

(a) There exists a norm on M" such that the induced matrix norm of P is 
at most one. 

(Hi) All the eigenvalues of P have modulus at most one and all the eigen- 
values of modulus one are semi-simple. 

(iv) The origin is a Lyapunov stable fixed point of P. 

In the analysis of convex monotone dynamical systems, it is useful to 
distinguish various notions of stability that are weaker than the classical 
Lyapunov stability. 

Proposition 3.2. If f : V ^ D is a convex monotone map with a fixed 
point V ^T), then the following assertions; 

(i) V is a Lyapunov stable fixed point, 

(a) there exists a neighbourhood VCD of v such that every orbit of x (zV 
is bounded, 

(Hi) there exists a neighbourhood V C P of v such that every orbit of x (zV 
is bounded from above, 

(iv) every orbit of f^: M" — ?■ M" is bounded, 

(v) every orbit of f^: M" — ?• is bounded from above, 

(vi) each P E df{v) is stable. 

( vii ) every orbit of f^ : M" — ?• M" is bounded from below, 
(via) every orbit of f : D ^ D is bounded from below, 
satisfy the following implications: 

(i) 44> (ii) ^ (Hi) =^ (iv) <^ (v) (vi) =^ (vii) =^ {viii). 
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Proof. The implications (i) =^ (ii) (Hi) and (iv) =^ (v) are trivial. We 
start by showing that (in) implies (v). Let x > be such that v + x £ V. 
Remark that f{v + x) > f{v) + /^(x) = v + f[X^)- Since / is monotone, we 
deduce that 

f^{v + x)>v + {f[f{x) for all k > 1, (7) 

and hence /^) is bounded from above. As is monotone and positively 
homogeneous, there exist for each y G M", a vector x > and a scalar A > 
such that y < Xx and v + x £ V. Thus, we get that has all its orbits 
bounded from above. 

Next we prove that (f ) implies (vi). If P G df{v), then we know by 
that flj{x) > Px. As is monotone, we get that {f^)^{x) > P^x for all 
A; > 1 and x G and therefore P has all its orbits bounded from above. 
This implies that P has all its orbits bounded, since P is linear. 

Suppose that df{v) contains a stable matrix P. We deduce from 
that {f'v)^{x) > P^x for aU /c > 1 and x G M". As P is stable, this implies 
that 0{x\ fy) is bounded from below, which shows that (vi) implies (vii). 

To see that (vii) implies (viii) let x G P and note that, by ([7]), 

f''{x)>v + {f^)''{x-v) for all A: >1. 

As 0{x — v; f'y) is bounded from below, we get that 0{x; f) is also bounded 
from below. 

Note that (v) implies (vi) and (vi) implies (vii), so that (iv) and (v) are 
equivalent. Similarly, (iii) implies (viii), so that (ii) and {in) are equivalent. 
It remains to be shown that (ii) implies (i). 

If (ii) holds there exists u ^ such that v + Xu £ "D for all |A| < 1 and 
0{v + u; f) is bounded. Let k > 1 and note that for < A < 1, 

X{f'{v + u)-v) = Xif'{v + u)-v) + {l-X){fHv)-v) 
> f''{X{v + u) + {l- X)v)-v 
= f^{v + Xu)-v . 

Take P G df{v) and remark that /(x) > P{x — v) + v. This implies that 
f^{x) > P^{x — v) + V for all x G P. Hence 

f{v -Xu)-v> -XP^u for < A < 1. (8) 

As {ii) implies {vi), we know that P is stable. Define a norm || • ||u on M" 
by ||x||„ = inf{a > 0: — au < x < au} and let 

7 = sup{||P*^u|U, \\f''{v + u)- v\\u}. 

k>l 
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Note that 7 < oo, as P is stable and 0{v + u; f) is bounded. Let A := 
||x — v\\u, so that V — Xu<x<v + Xu. If A < 1, we get that —X^u < 
f^{x) — V < X^u for each k > I. Thus, — v\\u < 7A = j\\x — v\\u for 

all X G P such that 11 

— ^ 1 and for all k ^ 1. Hence f is a Lyapunov 
stable fixed point. □ 

Example 1. Let /: — > R"' be given by f{x) = max{0,x + x^} for 
X € M". Then /q(x) = max{0,x} and hence every orbit of /q is bounded. 
However, the orbit of each x > is unbounded under /. This show that (iv) 
does not imply {in). 

Example 2. This example shows that (vi) does not imply (v). Consider 
h{p) = —plogp — {1 — p) log(l — p) for p G [0, 1], and define (7: — )■ by 

g{x) = sup pxi + h{p)x2 for x = (xi,X2) G M^, 
pe[o,i] 

which is the Legendre-Fenchel transform of —h. Note that g[x) = X2 log(l + 
Qx-i_/x2^^ for X2 > 0. Indeed, put X2 = 1 and consider 

■^{pxi + hip)) = 0. 
dp 

Solving for p gives p = e^^ / {1 + e^^), so that g{xi, 1) = log(l + e^^). As g is 
positively homogeneous, g{x) = X2log(l + e^^/^^) for X2 > 0. 
Now define / : ^ by 

. , . _ J max{0, xi} if X2 < 
•^^^^^ ~ \ X2log(l + e^i/^2) ifx2>0 

and /2(x) = X2 for all x = (xi,X2) G . If X2 > 0, we get that (x) = 
X2 log(/E + e^i/^^) — )■ 00, as /c — )■ 00. Thus, not all orbits of /q = / are 
bounded from above. But 9/(0) consists of matrices of the form 

where < s < h{p) and < p < 1. 

As h{l) = 0, all these matrices are stable. 

Example 3. To see that [vii) does not imply [vi) we consider the map 
/: M — )> M given by /(x) = max{0,2x} for x G M. Then /q = /, so every 
orbit of /q is bounded from below, but 2 G 9/(0). 



(p s\ 

lo I 
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Example 4. To prove that {viii) does not imply [vii) consider / : ^> 
given by 

/(:;)=r^r"') tor. tf. 

Then 

so that 0{—u; /q) is unbounded from below for n ^ 0. But clearly every 
orbit of / is bounded from below. 

We use the following notion of stability which is weaker than ordinary 
Lyapunov stability according to Proposition 13.21 

Definition 3.3. Let /: "D — > "D be a convex monotone map and v £ D 
be a fixed point of /. We say that u is a tangentially stable, or, t-stable, 
fixed point if has all its orbits bounded from above. Similarly, we call a 
periodic point ^ € D with period p tangentially stable if it is a t-stable fixed 
point of fP. 

We note that if is a t-stable periodic point of / with period p, then 
f^{v) is also t-stable for each < m < p. Indeed, as 

{F)'. = {F-n'f^i.)o{r)'. and (/7/™(.) = (rx°(r~"^)/™(.), 

we get that 

Thus, every point in the orbit of a t-stable periodic point is also t-stable. 
We denote by £{f) the set of all fixed points of / and we let 

£^{f) = {v ^ £■(/): v is t-stable}. 

The subdifferential of a t-stable fixed point consists of nonnegative stable 
matrices by Proposition 13.21 In the next section we collect some results 
concerning stable matrices that will be useful in the analysis. 

4 Stable nonnegative matrices 

To an n X n nonnegative matrix P = (pij) we associate a directed graph 
G{P) on n nodes, in the usual way, by letting an arrow go from node i to 
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j if pij > 0. We say that a node i has access to a node j if there is a 
(directed) path in ^(P) from i to j. Using the notion of access one defines 
an equivalence relation ~ on {1, . . . ,n} by i ~ j if i has access to j and 
vice versa. The equivalence classes are called classes of P. A nonnegative 
matrix P is called irreducible if it has only one class. Otherwise it is said to 
be reducible. 

The spectral radius of P is given by p{P) = max{|A| : A eigenvalue of P}. 
If P is a stable nonnegative matrix, we call a class C of P critical if p{Pcc) = 
1. Recall that in Perron- Frobenius theory a class C of P is called basic if 
p[Pcc) = p{P)- Thus, all critical classes of a stable nonnegative matrix are 
basic by Proposition 13.11 The following proposition is a direct consequence 
of [271 Theorem 3] (see also [29l Corollary 3.4]) and Proposition 13.11 

Proposition 4.1. If P is a nonnegative stable matrix and C and C are 

two distinct critical classes of P, then no i (z C has access to any j E C . 

Moreover, we have the following general fact concerning nonnegative 
matrices (cf. [m Chapter XIII §3.4]. 

Proposition 4.2. If P is a nonnegative matrix, then p{P') < p{P) for all 
principal submatrices P' of P. If P is reducible, then the equality holds for 
at least one principal submatrix P' of P with P' ^ P. 

Using these proposition we now prove the following useful normal form 
for stable nonnegative matrices. 

Proposition 4.3. If P is a nonnegative stable nxn matrix, then there exist 
a permutation matrix 11 and a unique partition of {1, . . . ,n} into disjoint 
sets U , C , D, and I such that 

( Puu Puc Pud Pui \ 
Pec PcD 
Q Pdd ^ ' ^ ' 

V P/z) Pii I 

where C is the disjoint union of the critical classes Ci, . . . ,Cr of P, 

(a) Pec 'is block- diagonal, with blocks Pdd for 1 < i < t, 

(Hi) every i G U has access to some j S C, and for every i G D there exists 
j £ C that has access to i, 

(iv) I = {l,...,n}\{UUCUD). 



(i) 



n^pn 
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Figure 1: Partition associated with a stable matrix 

Moreover, in that case, we that p{Puu) < 1> p{Pdd) < 1. o-i^'d p{Pii) < 1- 

Proof. Let C be the union of the critical classes Ci, . . . , C,. of P. Then Pec 
is block diagonal by Proposition 14. II Let U be the set of nodes of Q{P) not 
in C that have access to some i C. In addition, let D be the set of nodes 
i in G{P) that are not in C, but from which there exists j € C such that 
j has access to i. We remark that U (1 D = Indeed, if i G U (1 D, then 
there exist ji,j2 ^ C such that i has access to ji and j2 has access to i, 
By Proposition 14. H ji and j2 are both in a single class, say Cm- But this 
implies that i G Cm, which is a contradiction. In fact, the same argument 
shows that Pdu = 0, Pcu = 0, and Pdc = 0. 

Now let / = {1, . . . , n} \ ([/ U C U D). By definition no node in / has 
access to a node C, nor can it be accessed by a node in C. Hence Pjc = 
and Pci = 0. Furthermore, the definition of U and D implies that Pju = 
and Pdi = 0. Thus, the sets U, C, D, and /, communicate as in Figure 
[1] and hence there exists a permutation matrix 11 such that II^PII satisfies 

m- 

To prove the final assertion, we remark that if p{Puu) = 1, then there 
exists a critical class U* C U such that p{Pu*u*) = p{Puu) = 1 and Pu*u* 
is irreducible by Proposition 14. 2| which is a contradiction. In exactly the 
same way it can be shown that p{Pdd) < 1 and p{Pn) < 1. □ 

The set of nodes U, C, D, and / in G{P) are respectively called up- 
stream nodes, critical nodes, downstream nodes, and independent nodes. By 
using the normal form and the Perron-Frobenius theorem we now prove the 
following assertion. 

Proposition 4.4. If P is nonnegative stable nxn matrix and Pz < z, then 
(i) Pcczc = zc, 

(a) ZD = and {Pz)cuD = zcuD, 
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(in) Z[ > 0, 

(iv) if, in addition, zs > for some S C {1, . . . , n} that contains at least 
one element of each critical class of P, then z > 0. 

Proof. As Pz < z, it follows from Proposition 14.31 that Pddzd ^ -^d- Since 
p{Pdd) < we get that {Pdd)^Z£) — > as A; ^> oo, and hence zd > 0. This 
imphes that 

zc > Pcczc + PcDZD > Pcczc- (10) 

Let Ci, . . . ,Cr be the critical classes of P. As Pdd is nonnegative and 
irreducible, it follows from the Perron-Probenius theorem |1H Theorem ??] 
that there exists for each 1 < i < r a positive m* G M*-^' such that m^Pc^d = 
m*. Put m = {mi, . . . , mj.) € M*^ and remark that, as Pec is block diagonal 
that mPcc = Multiplication by m from the left in (jlOp gives 

mzc > mPccZc + mPcDZD > mPccZc = mzc- 
As m is positive, we deduce that 

PcDZD = and Pcczc = zc, (H) 

which proves [i). 

Recall that zd > 0. To show [ii) we assume by way of contradiction 
that Zj > for some j S D. By definition there exists a path (ii, . . . , ig) in 
Q{P) with i = ii G C , i2, ■ ■ ■ , iq £ D , and j = iq. Since < z we get that 

9-1 

{PcDZD)i = PiDZD > PiiiiZi^ > Pi^i^Pi^i-^Zi.^ >•••>( JJ Pikik-i) ^iq > 0' 

fc=l 

which contradicts (llip and hence z_d = 0. By Proposition I4.3r z) we also find 
that {Pz)cuD = zcuD- 

To prove that zj > 0, we remark that zj > Pjdzd + Piizi = Piizj by 
(ii). As p{Pii) < 1, we get that zj > PjjZj — >■ as A; — )■ oo, so that zj > 0. 

Finally assume that S Q {1, . . . ,n} contains at least one element in each 
critical class of P and zs ^ 0. Remark that zu > Pui/zu + Puczc + 
Puizj > Puuzu + Puczc, since zj > 0. As p{Puu) < 1) we get that 
(/ - Puuy^ = Y^k>{)Puu is nonnegative and 

zu>{I-Puur^Puczc. (12) 

As each Pdd is irreducible and p{Pdd) = 1, it follows from the Perron- 
Frobenius theorem that Zd is a multiple of the unique positive eigenvector 
of Pdd ■ By assumption zc^ has at least one positive coordinate, and hence 
Zc ^ 0. It now follows from (I12p that Z(/ > and therefore z > 0. □ 
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For z G M"" and S C {1, . . . ,n} we simply say that z = on S", or, z 
is zero on (S, if zs = 0. Similar terminology will be used for > and 
^5 ^ 0. Given a collection V of nonnegative n x n matrices we define 

g{V) = U g(P), (13) 

and we observe that the following lemma holds. 

Lemma 4.5. If V is a convex set of nonnegative nx n matrices, then there 
exists M eV such that Q{M) = g{V). 

Proof. Since the number of edges in Q{'P) is finite there exist T finite 
such that Q{F) = Q{V). Define M = HqeJ^Q and note that M G V, 

as V is convex. Moreover, Q{M) = Q{T) = G{V). □ 

For a stable nonnegative matrix P, we let N^[P) denote the set of critical 
nodes of Q{P) and we let Q'^{P) denote the restriction of Q{P) to N^{P). 
For a collection of stable nonnegative n x n matrices, "P, we define 

N\V) = U N\P) and g\V) = \J g'{P). (14) 

pg-p P(Z-p 

Using these concepts we can now present the main theorem of this section. 

Theorem 4.6. If V is a convex rectangular set of stable nonnegative nxn 
matrices, then there exists M G "P such that Q^{M) = Q'^{V). 

Proof. The assertion is trivial if Q^{V) is empty. Let be a finite set of 
matrices in V such that Q'^{T) = G'^iV). For each A; G N^{V) we let 

Qfc = {Pfc: PGT-and A;GiV^(P)}. 

For k N'^{V) we pick an arbitrary P G P and put Qk = {Pk}- Subse- 
quently we define an n x n nonnegative matrix M by 

Mfc = IQfeT^ ^ q for 1 < A; < n. 

As V is convex and rectangular, M G P and hence Q'^{M) C Q'^{V). 

We claim that Q^{V) C Q(M) by construction. Indeed, if {i,j) is an arc 
in g'^{V), then there exists P £ J- such that {i,j) is an arc in Q'^(P). This 
implies that i G N^iP) C N^iV) and Pj G Qj. As P^j > 0, we get that 
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Thus, g^{M) C g^{V) C g{M), so that 



(Here ^^('P)|Arc(M) denotes the restriction of the graph Q^{V) to the nodes 
in iV^(M).) As A^^(M) C iV^(P), it remains to prove that N^iV) Q N^iM) 
to estabhsh the equahty Q'^{M) = Q'^{V). To show the inclusion we use the 
following claim. 

Claim. If C is the set of nodes of a strongly connected component of g'^{V), 
then p{Mcc) = 1- 

If we assume the claim for the moment and take i G N'^(V), then there 
exists a strongly connected component C in Q'^{V) such that i & C. Clearly 
there exists a class C* of M such that C Q C* and hence 1 = p{Mcc) ^ 
p[Mc*c*) by Proposition 14. 21 and the claim. This implies that C* is a critical 
class of M and therefore i G 7V'=(M). 

To prove the claim we consider a nonlinear map g : M.^ — > given by, 

= sup qcy for A; € C and y G M^. 

geQfc 

We begin by constructing an eigenvector u ^ for g. As g is monotone, 
positively homogeneous, and continuous, we can use the Brouwer fixed point 
theorem to find u G M^jl, with u ^ 0, and A > such that g{u) = Xu (see 
[21 pp. 152-154] or [171 P-201]). Since T is finite, Qk is finite, and hence the 
sup is attained for u and k ^ C, say by G Qk- Now let Q be the n x n 
nonnegative matrix with Q^. = for all /c G C and Qk is some element in 
Qk for all k ^ C. As is rectangular, Q G P. Moreover, Qccu = g{u) = An 
and p{Qcc) < /3(Q) < 1, as Q is stable. Thus, we find that A < 1. 

Now note that if {11,12) is an arrow in Q'^{V), then there exists q G Qj^ 
with qi^ > 0. This implies that if x G and x-i^ > 0, then 

g^i^) > %^i2 > 0- (15) 

Since C is a strongly connected component of Q'^iV), there exists a path 
from any i to any j in C. Recall that u G and u 7^ 0. Hence there exists 
j € C such that > 0. Now let {io,h, ... ,v) be a path in G'^{V)\c from 
i = iQto j = ir- By ([I5|), gi,_^{u) > qi^Ui^ > 0, and gl^^{u) > qi,_^giXu) > 
Qir-iQir^ir > 0. By repeating the argument we get that 

r 

Ui = 9iiu) = gliu) > ( Yl qtk)utr > 0. 

k=l 
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Thus, Ui > for all i ^ C. 

Let k ^ C and q & Qk- Then there exists P € J-" such that q = and 
k € N'^{P). Moreover, there exists a critical class C of P with k C C 
and p{Pc'C') = 1- We note that 

-Pc'C'^^c < Pc'cu < g{u)c' = >^uc' < uc, (16) 

as Pi € Qi for all / G C". Since ti is positive on C , it follows from Proposition 
I4.4( i) that Pcc'^c' = uc'^ so that A = 1 and Pc'c'^ = ^^c" by (fT6|) . There- 
fore, if A; € C and q £ Qi^, then (/c-n = PfcC^ = ''^fc) so that Mj^c'^ = ^fc for 
all k G C. From this we conclude that Mccu = u and hence p{Mcc) = 
which proves the claim. □ 



5 Tangentially stable fixed points 

By using the results from the previous section we can now start analysing 
the t-stable fixed points of monotone convex maps. To begin, we have the 
following lemma. 

Lemma 5.1. If f : D V is a convex monotone map and v and w are 

t-stable fixed points of f, then Q'^{df{v)) = Q'^{df{w)). 

Proof. Prom Propositions 12. i j 12.21 and 13.21 it follows that df{v) and df{w) 
are convex rectangular sets of stable nonnegative n x n matrices. By Theo- 
rem |46] there exists M G df{v) such that Q'^{M) = Q'^{df{v)). Moreover, 

w — V = f{w) — f{v) > M{w — v), 

so that w — V = M{w — v) on C U D, by Proposition 14.41 (Here C and D 
are the critical nodes and the downstream nodes of M.) This implies that 

fi{v) - ft{w) = {v- w)i = Mi{v - w) for a\\ieC\JD. 

From this equality we deduce that 

f^{x)-fi{w) = f,{x) - fi{v) + fi{v) - f,{w) 

> Mi{x - v) + Mi{v - w) 
= Mi{x-w) 

for a\l X eV and i e C U D. Thus, Mi G dfi{w) for alii eCUD. Now let 
P G df{w) and define Q G Vn,n by 

fMi ifiGCUD 
* 1^ Pi otherwise. 
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As df{w) is rectangular, Q G df{w). Clearly g^{f{w)) 2 G^{Q) 5 ^'(M) = 
Q'^{df{v)). By interchanging the roles of v and u; we obtain the desired 
equality. □ 



By Lemma [5. II we can define for a convex monotone map f : T> ^ T> with 
a t-stable fixed point v £ V, the set of critical nodes of f and the critical 
graph of f respectively by, 

N'if) = N'{df{v)) and Q^if) = g'{df{v)). 

Lemma 5.2. Let f : T> D be a convex monotone map and let v € T> be 
a t-stable fixed point of f . Let S C {1, . . . , n} 6e a set that contains at least 
one node in each connected component of Q'^{df{v)). If w £ V is a fixed 
point of f and v < w on S, then v < w. 

Proof. By Theorem l4.6l there exists M G df{v) such that Q^[M) = Q^{df{v)). 
Then w — v = f{w) — f{v) > M{w — v) and w — u > on 5, so that w — v>Q 
by Proposition 14.41 ^^^;) . □ 

Prom the previous lemma we immediately deduce the following theorem 
for t-stable fixed points. 

Theorem 5.3. Let f : T> ^ T> be a convex monotone map and let v,w (zD 
be t-stable fixed points of f . If v = w on a set S C {1, . . . , n} that has at 
least one node in each strongly connected component of Q^{f), then v = w. 
In particular, the t-stable fixed point is unique, if N'^{f) is empty. 

To analyse the geometry of the t-stable fixed point set £-t{f) and t- 
stable periodic points, we need some preliminary results concerning convex 
monotone positively homogeneous maps. 

6 Positively homogeneous maps 

If h: M" M" is a monotone convex positively homogeneous map, then 
is a fixed point and we can associate to /i a graph Q{h) by 

G{h)=G{dh{fd)). 

If, in addition, is t-stable, then we define 

A{h) = {i: there exists a path in Q{h) from i to some j G A^^(/i)} 

and we put B{h) = {1, ... ,77,} \ A[h). Convex monotone positively homo- 
geneous maps, which have as a t-stable fixed point, have the following 
properties. 
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Lemma 6.1. Let h: M"6e a convex monotone positively homogeneous 

map, with as a t-stahle fixed point. Write C = N^{h), A = A{h), and 
B = B{h), and identify each x with (x^, xs) G x M^. Then CCA 
and the map h can he rewritten in the form 

h{xA,XB) = {hA{xA,XB),hB{xB)), 

where Ha - M.^ x M"^ M.^ and Kb - M.^ — ?• M.^ are convex monotone posi- 
tively homogeneous maps. Moreover, if h^ : M.^ — )> M.^ is given by, 

h^{y) = hA{y,^) for ally eR"^, 

then for each y E with yc ^ ^ o-nd each i G A, there exists k > 1 such 
that (y) > 0. 

Proof. Since h is convex and positively hommogeneous, h'^ = h and h{x) = 
suppgg/j^Q) Px for all x G M". Since i? = {1, . . . , n} \ A, we can write h in 
the form 

h{xA,XB) = {hA{xA,XB),hB{xA,XB))- 

We note that Pba = for all P G dh{0). Indeed, otherwise there exists 
j € B that has access to some node i G A in Q{P). But this implies that 
there exists a path from j to a node in C in Q{h), as Q{P) C Q{h), which 
contradicts j G B. Since dh{0) is rectangular, 

hB{xA,XB)= sup Pbaxa + Pbbxb= sup Pbbxb- 

P£dh{0) P£dh{0) 

Thus, hB{xA, xb) is of the form hB{xB), and therefore h can be rewritten 
as 

h{xA,XB) = {hA{xA,XB),hB{xB)), 

for all {xa,xb) G x M^. 

To prove the last assertion we let y G be such that yc ^ and i & A. 
By Lemma 112] there exists P G dh{0) such that Q{P) = G{h). We have that 
h^{z) = hA{z,Q) > Paaz for all z G M^. Hence {h'^fiy) > {PaaYv for all 
k > 1. Since there exists a path from i G A to some node j C, say with 
length m > 1, we get that {h'^){y)i > {PAA)Tjyj > 0- ^ 

By using the previous lemma we prove the following proposition. 

Proposition 6.2. Ifh: M" — )■ M" is a convex monotone positively homoge- 
neous map, with as a t-stable fixed point, and h has a fixed point v such 
that V ^ on A(h), then v = on B{h). 
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Proof. By Theorem gj] there exists M G dh{0) such that Q^^M) = Q^ih). 
Let Ci, . . . ,Cr denote the critical classes of M, so C = Ci U ... L) Cr- By 
the Perron-Frobenius theorem there exists for each 1 < i < r a positive 
eigenvector n* G M*^' such that M^c'.ii* = u*. Define n G M" by Ud = 
for 1 < i < r and tij = if j C. Clearly u > 0, u ^ on C , and Mtt > it. 
This implies that 

h{u) > Mu > n > 0. (17) 

As is t-stable and h = Hq, we know that 0{u,h) is bounded. Moreover, 
it follows from ([IT]) that {h^{u))k is increasing and hence v = limfc_j.oo hf' (u) 
exists. Obviously f is a fixed point of h and u > u, so that f on C 
Remark that ub = 0, because i? H C = 0. Therefore = by Lemma l6. II 
and hence va is a fixed point of h^. By the second part of Lemma l6.ll we 
obtain that va ^ 0, as vc ^ 0. □ 

For a positively homogeneous map h: — )• R" the spectral radius is 
defined by 

r(/i) = sup{A > 0: h{x) = Xx for some x G M+ \ {0}}. (18) 

Proposition 6.3. Let h: be a convex monotone positively ho- 

mogeneous map, with as a t-stable fixed point. If hs- R^ — ?• is as in 
Lemma \6.1\ then T{hB) < 1- 

Proof. Assume by way of contradiction that T{hB) = r > 1. Then there 
exists > with v ^ Q such that hsiv) = rv > v. But hsiv) = 
suppgg/i(o) Pbbv and 9/i(0) is a rectangular compact set of stable nonnega- 
tive matrices. Hence hB{v) = Qbbv = rv for some Q G dh{0). This implies 
that a class K of Q such that K B and p{Qkk) = r > 1. As Q is stable, 
r = 1, and hence K C N^[Q) C N^[h) C ^, which is a contradiction. □ 

It is shown by Nussbaum pT[ Theorem 3.1] that t(/i) = t'(/i), where 
r'(/i) is the so called Collatz-Wielandt spectral radius of a monotone posi- 
tively homogeneous map h: M" ^ M", which is given by 

r'(/i) = inf{/_f > 0: h{x) < fix for some x ^ 0}. (19) 

Thus, Proposition 16.31 has the following consequence. 

Corollary 6.4. // h: M" M" is a convex monotone positively homoge- 
neous map, with as a t-stable fixed point, and Hb is as in Lemma \6.1\ then 
there exist < A < 1 and ^ such that hB{w) < Xw. 
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We conclude this section by showing that a monotone convex positively 
homogeneous map with as a t-stable fixed point is non-expansive with 
respect to a polyhedral norm. Recall that a norm on M" is called polyhedral 
if its unit ball is a polyhedron. 

Theorem 6.5. Let h: — )• be a monotone convex positively homoge- 
neous map with as a t-stable fixed point, then there exist ^ and a > 
such that h is non- expansive with respect to the polyhedral norm, 

llxIL = max \xi/vi\+a max \xi/vi\ forxGM"', (20) 
ieA{h) ieB{h) 

where A{h) and B[h) are as in Lemma \6.1\ 

Proof. We use the same notation as in Lemma 16.11 By Proposition 16.21 h 
has an eigenvector u G such that u ^ on A = A{h) and u = on 
B = B{h). Moreover, by Corollary 16.41 there also exists < A < 1 and 
w eM.^ such that w » and hsiw) < Xw. Let v G x R-^ be defined by 
V = u on A and v = w on B. Further let W be the diagonal matrix with v 
as its diagonal and define 5: ^> by g{x) = {W~^ oho W){x) for all 
x € M". It follows from Lemma |6. II that we can write g in the form 

g{x) = {gA{xA,XB),gB{xB)), 

where gA '■ x — >■ and gB '■ R'^ — R^ are convex monotone positive 
homogeneous maps. Moreover, (7^(/il,0) = /.tl and gBip^) < A/il for all 
/i > 0, where 1 denotes the vector with all coordinates unity. 

We write || • ||oo to denote the sup-norm, so ||^||cxd — max^ |x^|. Remark 
that 

9{x)b - g{y)B < g{x - y)B = gB{{x - y)B) < A||(x - y)B||ool, 

as g is convex, monotone and positively homogeneous. By interchanging the 
roles of x and y we deduce that 

\\g{x)B - g{y)B\\oo < X\\xB - yB\\oo for all x, y G R". (21) 

Subsequently we remark that there exists C > finite such that 5^(0, x^) < 
Cll^^sllool, as gA is continuously and positively homogeneous. (Recall that 
g{x) = suppggg(o) Px for each x S R".) Thus, for each x £ R", 

g{x)A = gA{xA,XB) < gA{xA,0) +5b(0,xb) < ||xa||oo1 + C||2;b||oo1. (22) 
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As g is convex, 

g{x)<g{x-y)+g{y), (23) 

so that g{x) — g[y) < g{x — y) for all x,y ^ M". As g((0) = 0, we have that 
~giy) ^ 9i~y)y ^ind hence it follows from (j22p that 

\\gix)A\\oo < \\xa\\oo + C\\ 

Woo 

(24) 

for all X eW. It also follows from that 

\\g{x)A - S'(y)A||oo < max{||5(x - y)A\\oo, \\g{y - x)a\\oo}- (25) 
Now let a > C/(l - A) and define || • ||' on by 

\\x\\' = llxyilloo + alkBlloo for ah x eR^ x . 



It now follows from (|2TD, ^ and ^ that 

115(2;) -5(^)11' = \\9{x)a - 9{y)A\\oo + a\\g{x)B - g{y)B\\oo 

< \\{x- y)A\\oo + C\\{x - y)B\\oo + aA||(x - 2/)b||oo 

< ||(x - y)^||oo + a||(x - y)B||oo 

= ll^^-yll'- 

Finally, we recall that g o = o g^ so that h is non-expansive with 
respect to ||VF~"'^(-) II' = II ' \\v and we are done. □ 

7 The tangentially stable fixed point set 

Throughout this section we assume, in addition to Hypothesis 12.31 that the 
domain D C R" satisfies the following property. 

Hypothesis 7.1. The domain T) C M" is a downward set, i.e., if x ^ T> 
and y < X, then y ^T>. 

Given a convex monotone map f : T) — )• T> we define £~^{f) = {z € 
T^'- f{z) < z}. As / is convex, £^{f) is convex. There exists a natural 
projection from £'^{f) onto S{f) if / has a t-stable fixed point (cf. [H Lemma 
3.3]). 

Lemma 7.2. If f : T> ^ T> is a convex monotone map with a t-stable fixed 
point, then 

f^{z) = hm f\z) (26) 

fe— >-CXD 

exists and f^{z) = z on N^{f) for each z G S~^{f). In addition, the map 
f^: S~^{f) £{f) is a surjective convex monotone projection, i.e., {f^Y — 

r- 
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Proof. Since f : V V has a t-stable fixed point, all orbits of / are bounded 
from below by Proposition 13.21 Therefore, f'^{z) = \mii^^^f^{z) exists for 
all z G £~^{f), as {f^{z))k is a decreasing sequence and V is downward. By 
continuity of /, ^^{z) is a fixed point of /. 

Let u be a t-stable fixed point of / and z € £'^{f). By Theorem 14.61 
there exists Q € df{v) such that g%Q) = Q%df{v)) = g%f). We also have 
that 

z-v> f{z) -v = f{z) - f{v) > Q{z - v). (27) 

From Prop osit ion 14 . 4 1 it follows that z — v = Q{z — v) on N'^{f) = N'^{Q) and 
hence z = f{z) on N'^[f). Replacing z by f^{z) in the previous argument 
gives f+^{z) = f{z) = ... = z on N%f) for aU k > 1. Thus, /'^(z) = 
limk^^f lz) = z on iV^(/). Clearly, /"^(x) = x if x G £{f), so that 
S^{f) £■(/) is onto and (Z"^)^ = . Moreover, as is the pointwise 
limit of {f^)k, is a convex monotone map. □ 

The fixed point set £{f) can be naturally equipped with a binary oper- 
ation that turns (£"(/), Aj) into an inf-semilattice, ii f: V V has a 
t-stable fixed point. The relation Aj is £{f) is defined by 

X Afy = lim f''{x Ay). (28) 

fc— )-oo 

We note that if x, y G £"(/), then f{x Ay) < f{x) = x and f{x Ay) < f{y) = 
y, so that /(x Ay) < x Ay. As f : V ^ V has all its orbits bounded from 
below and D is downward, the limit (I28p exists. To prove that {£{/), Af), 
is an inf-semilattice one has to show that Aj is associative, symmetric, and 
reflexive, which is a simple exercise. It also follows from Lemma 17.21 that 
if we put C = N^{f) and define re - £{f) M'^ by rc(x) = xc for all 
X € £{f), then rc{£{f)) is an inf-semilattice in M*^, where A is the infimum 
operation induced by the partial ordering < on M*-^. Indeed, if x,y G £{f) 
and u G P is a t-stable fixed point of / : V ^ D, then there exists M G df{v) 
such that Q'^iM) = G^if). As /(x Ay) < /(x) = x and /(x Ay) < /(y) = y, 
/(x Ay) < X Ay, so that /'^(x Ay) < f^~^{x A y) for all /c > 1. This implies 
that 

/'=-i(x A y) - t> > /^(x Ay) - f{v) > M{f^-\x Ay)-v). 
By Proposition 14.41 we get that 

f^-^{x Ay)-v = f{x Ay)- f{v) = f^{x Ay)-v 
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on C for all A; > 1. Hence 

rc{x Afv) = {x Af y)c = lim f''{x A y)c = {x A y)c = rc{x) A rc{y), 

k—^oo 

SO (rc(£'(/)), A) is an inf-semilattice in R*^. The difference between {£{f),Af) 
and {rc{£{f)), A) is illustrated by the following simple example. Consider 

/O 1/2 1/2 
P= 1 
\0 1 

So, P is a projection. Clearly, £{P) = span{(l/2, 1, 0), (1/2, 0, 1)}, but 
S{P) is not an inf-semilattice with respect to A, as (1/2,0,0) = (1/2, 1,0) A 
(1/2,0,1) is for instance not in £{P). In this case N^{P) = {2,3} and 
span{(l, 0), (0, 1)} is an inf-semilattice with respect to A. 

Let us now analyse the t-stable fixed point set in more detail. We shall 
prove the following theorem. 

Theorem 7.3. If f : D ^ D is a convex monotone map with a t-stable fixed 
point, then {£t{f),^f) is an inf-semilattice and {rc{£t{f)), A) is a convex 
inf-semilattice in , where C = N'^{f). 

But first we give two preliminary lemmas. 

Lemma 7.4. Let f : T> ^ D be a convex monotone map with a t-stable fixed 
point. Let z G £^{f) and w = f^{z) be given by [2B\) . Write S = {i: Wi < 
Zi } and E = {i: Wi = Zi}. Then the map h = f^ can be written in the form 

h{xs,XE) = {hs{xs,XE),hEixE)), (29) 

where hs- M'^ x — )• M.^ and hE- are convex positively homo- 

geneous maps. Moreover, the map : M*^ M"^ given by, h^{y) = hs{y,0) 
for y G , satisfies T{h^) < 1. 

Proof. Since h{x) = suppggjj-^) Px for all x G and f{z) < z, we get that 

z-w> f{z)-w>h{z-w). (30) 

As z — w >0 and z = w on E, we find that h{z — w) = on E. Now suppose 
that that y G M" is such that yE = 0. Then there exists A > such that 
y < X{z — w), as z — w ^ on S. This implies that h{y) < Xh{z — w) < 
X{z — w), and hence h{y) < on E if y = on E. Now let ys, y'g G M"^ and 
yE ^ I^^; and remark that 

Hvs, yE)E < Hys - y's, 0)e + Ky'g, yE)E < Hv's^ yE)E, 
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as h is positively homogeneous and convex. Thus, h{ys, yE)E is independent 
of ys and hence h can written in the form (j29p . 

Let -.MP ^ M.^ be given by {y) = hs{y, 0) for all y G M"^ and denote 
v = {z- w)s. Then u » and by (jgU]) . 

V >h{z - w)s > h^iv). 

This implies that T{h^) < 1, as r 

(/jS) = T'{h^) by [211 Theorem 3.1]. (Here 
r(-) and t'(-) are as in ([18]) and (fT9|) . respectively. 

Assume by way of contradiction that T(h^) = 1. Then there exists 
ti € such that u 7^ and /i'^(n) = u. Then ?/ = (ti,0) G x 
satisfies /i(77) = 77 by (|29|) . Since df{w) is a compact rectangular set of 
nonnegative matrices and /i(?7) = supp^gj^^^ P?7, there exists P G df{w) 
such that ry = /i(Ty) = Prj. Let S' = {i: rji ^ 0} and remark that S' C S and 
5" is a union of classes of P. To proceed we need the notion of a final class. 
A class of a nonnegative matrix is called final if it has no access to any other 
class. It is known (see [SJ Theorem 3.10]) that a nonnegative matrix M has 
a positive eigenvector if, and only if, each final class of M is basic. Clearly 
Ps'S' has a final class, say F. As Ps'S'VS' = VS' and 7]s' ^ 0, we find that 
F is a basic class of Ps'S'j and hence p{Pff) = p{Ps'S') = 1- By ([30]) we 
have that 

{z-w)f > {f{z)-w)F > h{z-w)F > {P{z-w))f > Pff{z-w)f. (31) 

By the Perron-Frobenius theorem there exists m ^ in such that 
tuPff = ITT'- This implies that m{z — w;)_p > mPFFiz — w)f = 'ra[z — w)f, 
and hence {z — w)f = Pff{z — w)f- Thus, f{z)F = zf by ([3T]) . Similarly 
we deduce that f^[z)F = zf for all k > 1. Indeed, 

z-w> f\z) -w> if%iz -w) = {fif{z -w) = h'^iz - w) 

and 

h''{z -w)f> {P'')ff{z -w)f> [Pppfiz - w)f. 

Recall that wf = livuk-^oo {z) f and therefore wf = zf- But this 
implies that F Q E, which contradicts the fact that F C S' Q S. Thus, we 
conclude that T{h^) < 1. □ 

Lemma 7.5. Let h, He, , S and E he as in Lemma\T^ U^e ■ 

has all its orbits bounded from above, then h has all its orbits bounded from 
above. 
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Proof. Since h: M"" M" is monotone, it suffices to prove tliat 0{x;h) is 
bounded from above for all x € M". As h can be written in the form (j29p . 
we know that {h^{x)E- k > 0} = {h^{xE)- A; > 0} is bounded from above. 
It therefore remains to be shown that {h^{x)s- /e > 0} is bounded from 
above. Since T'[h^) = T{h^) < 1, there exist u € and < a < 1 such 
that n ^ and h^{u) < au. For y G R'^ we define a norm by 

||y||„ = max\yi/ui\. 

For each y € R^ we have that y < \\y\\uU, so that 

\\h^{y)\\u < ||/i^(||y|l«^i)||n = Wh'^ {u)\\u\\y\\u < a\\y\\u, 

as is positively homogeneous and monotone. Since {h^{x)E- k > 0} is 
bounded from above, there exists v ^ in R^ such that h^{x)E < v for all 
A; > 0. This implies that 

h{Q,h^{x)E)s <h{Q,v)s <iu 

for some 7 > 0. Now using the fact that h is positively homogeneous and 
convex, we get that 

< h''+\x)s < h{h\x)s, 0)5 + /i(0, h\x)E)s < h^{h''{x)s) + lu, 
so that 

\\h^+\x)s\\u < \\h'^{h'{x)s)\[a + 7 < a\\h''{x)s\\u + 7- 
By induction we obtain 

\\h''+^{x)s\\u < a^'||2;s||« + — 

1 — a 

which shows that {h^{x)s- A; > 0} is bounded from above. □ 
Let us now prove Theorem 17.31 



Proof of Theorem 7.3. To prove that {£t{f), Aj) is an inf-semilattice, it suf- 
fices to show that if x,y G £t{f)-, then x Aj y G Stif), as (£"(/), Ay) is 
an inf-semilattice. So, suppose that x,y G £t{f)- Put z = x /\y and let 
vj = X Af y. We need to show that h = f^: R" R" has all its orbits 
bounded from above by Proposition 13.21 By Lemma 17.41 we can write h in 
the form of ()29p . since f{z) < z. We also get that T{h'^) < 1. By Lemma [7. 51 
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it is sufficient to prove that He'- has aU its orbit bounded from 

above. For each i E we have that 

fi{w) = Wi = Xi Ayi = fi{x) A fi{y), 

as x,y,w G S{f)- Note that w < x Ay imphes that 

w + eu < {x Ay) + eu = {x + eu) A (y + eu) 

for ah u € and e > 0. Now let u € and e > sufficiently small so 
that X + eu, y + eu Then 

fi{w + eu) < fi{x + eu) A fi{y + eu), 

since fi is monotone, and hence 

fi{w + eu)-fi{w) < fi{x + eu)Afi{y + eu)-fi{x)Afi{y) 

< max{/i(x + eu) - fi{x),fi{y + eu) - fi{y)} 

for all z S -E. This implies that 

fw{u)i = lim < max{/^(u)i, f {u)i} (32) 

£4,0 e " 

for all i ^ E. 

Applying the same argument for the map /'^ and using the fact that 
(/fc); = for ah V G £{f), we obtain that 

(/;)'(n).<max{(/i)'=(u),,(/;)'=(u),} 

for all u G M", i ^ E and /c > 1. But x and y are t-stable and therefore 

ihE)Hs) = ihH0,s))E = iaH0,s)E 

is bounded from above as A; — )■ oo for all s G M^. Thus, we conclude that w 
is a t-stable fixed point of /. 

Recall that (rc(£'(/)). A) is an inf-semilattice in M*^, where C = N'^{f), 
and rc{x A/ y) = rc{x) A rc{y) for all x,y G £{f)- This implies that 
{rc {£t{f)) , /\) is a inf-semilattice in M*^. To show that rc{£t{f)) is convex 
we apply the same technique as before. 

Let x,y G £t{f) and < A < 1. Put z = Xx + {1 — X)y. Since / is convex, 

fiz) < Xf{x) + (1 - X)fiy) = Ax + (1 - X)y = z. 
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Hence w = f^^z) = lim.k~^oo {z) exists and is a fixed point of / witli 
wc = zc = Xxc + (1 — A)^^. We need to sliow that w is t-stable. Let 
h = and recall that is suffices to show that He all its orbit bounded from 
above by Lemma [731 Let i £ E and note that as x,y,w G £{f), 

ffiw) =w. = Ax. + (1 - A)y. = A/f (rr) + (1 - A)/f (y). 

Clearly w < Xx + {1 — X)y, so that 

w + eu < X{x + eu) + (1 — A)(y + eu) 

for all u G M" and e > 0. Now fix u G M". Then for all e > sufficiently 
small, we have that 

fHw+eu) < f^iX{x+eu) + il-X){y+eu)) < A/f (x+en) + (l- A)/f (y+en) 
for all > L Thus, 

fHw + eu) - ffiw) < Xiffix + eu) - /f (x)) + (1 - A)(/f (y + eu) - fHv)) 
and hence 

{f%{u). < A(rt(n). + (1 - A)(/^%(u). 

< A(/^)'^(n), + (1 - X){f'f{u), 

for all A; > 1 and i G E. As x,y G Stif), the right hand side is bounded 
from above as — )• oo. Therefore ((/4)'^(0, s)^;)^ = ((^£;)'^(s))fc is bounded 
from above for all s G M-^, which shows that w is t-stable. □ 

We note that if £t{f) is compact, then it is a connected set. To show 
this it suffices to prove that r^^ is continuous, as rc{£t{f)) is convex. Note 
that rc is one-to-one on £t{f) by Theorem 15. 3i So, let yk ^ y m rc{£tif)), 
fc{xk) = yk for all k, and rc{x) = y. If (x^Jj is a subsequence of (xfc)^ 
and Xfc. z, then z G £t{,f) by compactness. Moreover, rc{z) = y, which 
implies that zc = xc- Thus, by Theorem 15.31 z = x^ and hence r^^ is 
continuous. 

Another consequence of Theorem l7.3l is the following. Recall that C'(^) = 
• • • ' ^ ^ is a Lyapunov stable periodic orbit of / if for all 

neighbourhoods Ui of ^ = 0, . . . ,|? — 1, there exist neighbourhoods Vi 

of /*(^), i = 0, . . . ,p - 1, such that f''P+'{y) G for aU y e Vi for all A: > 0. 

Corollary 7.6. If f : V ^ D is a convex monotone map with a t-stable 
periodic point ^ ^T>, then f has a t-stable fixed point. Moreover, if ^ has a 
Lyapunov stable orbit, then f has a Lyapunov stable fixed point. 
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Proof. Let ^ £ Dhe a t-stable periodic point of / with period p. Put g = 
and note that f^{£,) is a t-stable fixed point of g for all < k < p. Let 
z = ^ A f{C) A • • • A Clearly g{z) < z and hence u := g'^iz) exists 

and is a t-stable fixed point of g by Theorem 17.31 As f^(z) < z for all 
< k < p, we have that 

f^u) = f{g''{z))=g^{fHz))<^ 

for all < /c < p. Li particular, f{u) < u and 

u = g{u) = r{u) < f{u) < u, 

so that /(n) = u. Moreover, as {f^T — 9u ^^^^ is continuous, we conclude 
that n is a t-stable fixed point of /. 

Now assume that ^ has a Lyapunov stable orbit. For each i = 0, . . . ,p— 1 
there exists a neighbourhood Vi of /*(^) such that the orbit of each y € Vi 
is bounded from above. Let Wi = {x G V : x < y ioi some y G Vi} and put 
W = U^ZoWi. Note that, as f{0 eVi, u eW and W is a neighbourhood 
of u. As / is monotone and the orbit of each y G Vi, i = 0, . . . ,p — 1, is 
bounded from above under /, the orbit of each w (z W is bounded from 
above, and hence ti is a Lyapunov stable fixed point. □ 

We also have the following result. 

Lemma 7.7. Suppose f : V ^ D is a convex monotone map and v and w 
are fixed points with w < v. If w <^ v or v Lyapunov stable, then w is 
Lyapunov stable. 

Proof. Suppose that w <^ v and let V = {x £ D: x <^ z he an open 
neighbourhood of w, where w <^ z <^ v. For each x V we have that 
X <^ V, so that f^{x) < f^{v) = V for all A; > 0. Thus, the orbit of x is 
bounded from above and hence w is Lyapunov stable by Proposition 13. 2[ 

Now assume that w < v and v is Lyapunov stable. Then there exists a 
neighbourhood U v such that the orbit of each y € C/ is bounded from 
above. Let W = {x £ T>: x < y for some y G C/}. Note that is a 
neighbourhood of since v (z U and w < v. As / is monotone, the orbit 
of each x € W is bounded from above under /, and hence w is Lyapunov 
stable. □ 

We conclude this section by showing that every t-stable fixed point of a 
convex monotone piece-wise affine map is Lyapunov stable. Recall that a 
map / : M" M" is piece-wise affine if can be partitioned into polyhedra 
such that the restriction of / to each polyhedron is an affine map. 
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Corollary 7.8. ///: M" — ?• is a convex monotone piece-wise affine map, 
then every t-stable fixed point of f is Lyapunov stable. 

Proof. Since / is piece-wise affine, we can find by [H Lemma 6.4] a neighbor- 
hood yy of such that f{v + x) = f{v)-\- f[,{x) for ah x € W. By Theorem 
I6.5l there exists a norm under which is non-expansive. Since /^(O) = 0, we 
can take any open ball, B, around for this norm, and get f[,{B) C B. By 
taking B of sufficiently small radius, we can guarantee that C VV. Since 
f{v) = V, we find for all x £ B that f{v + x) = v + fy{x) £ v + B, which 
shows that f{v + B) v + B. Since this inclusion holds for all balls B of 
sufficiently small radius, v is a Lyapunov stable fixed point of /. □ 

8 Tangentially stable periodic points 

For a directed graph Q and integer A; > 1 we let Q'' be the directed graph 
that has the same nodes as G and it has an arrow from node i to node j if, 
and only if, there exists a directed path of length k m Q from i to j. There 
exists the following relation between G'^if^) and (G'^if))^. 

Theorem 8.1. If f : D ^ D is a convex monotone map with a t-stable fixed 
point, then G^if^) = {G^if))^ for all k>l. 

To prove this theorem we reduce it to a special case, which was analysed 
in [1]. Recall that g: R"' — t- is called additively homogeneous if g{x + 
Al) = g{x) + Al for all x G and A G M. (Here 1 is the vector in W with 
all coordinates unity.) The map g is said to be additively subhomogeneous 
if g{x + Al) < g{x) + Al for all x G and A > 0. The following theorem 
for convex monotone additively homogeneous maps is proved in [H Theorem 
4.1]. 

Theorem 8.2 ([I]). If g. M" — t- is a convex monotone additively homo- 
geneous map with a fixed point, then G'^{g^) = {G^{g))^ for all k > 1. 

We note that every fixed point of a monotone subhomogeneous map 
g: M" M" is stable, because g is non-expansive with respect to the sup- 
norm j8]. Using a standard "cemetery state" argument, see [U Section 1.4], 
we derive the following consequence of Theorem 18.21 

Corollary 8.3. If g: is a convex monotone additively subhomo- 

geneous map with a fixed point, then G'^{g^) = {G'^id))^ for all k > 1. 
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Proof. Define h: M"+^ ^ M"+i by 



h{x,Xn+l) = 



Xn+lt +g{x - Xn+lt) 
Xn+1 



) 



for all {x,Xn+i) € M""'"^. It is easy to verify that /i is a convex monotone 
additively homogeneous map. Let v € M" be a fixed point of g and remark 
that w = {v, 0) is a fixed point of h. Due to the triangular structure of h, 
we see that dg{v) = dh{w)jj, where J = {1, . . . , n} and G'^{h) is the union 
of g^ig) with the loop {(n + 1), (n + 1)}. 

The same is true for the critical graph of g'' and h'^, as 



for all {x,Xn+i) G It follows from Theorem that Q^'ih^) = {Q^ih))^ 

for all k > 1. By considering the subgraph on the nodes {1, . . . ,n} we find 



We shall use the previous corollary to prove the following proposition, 
which is the key ingredient in the proof of Theorem 18.11 

Proposition 8.4. If f : V ^ T> is a convex monotone map with a t-stable 
fixed point v£V, then g\{f'^f) = {G'^ifi,))'' for aUk>l. 

Proof. Recall that : — > M" is a convex monotone positively homoge- 
neous map. Write h = f'^ and let A, B, C, Ha, and h"^ be as in Lemma 
16.11 Similar notation will be used for h^, so {h^)A) {^^)b and (h^)^. By 
definition of A we know that ^^(/i^) = G^ih). As V is a t-stable fixed point 
of /, is t-stable for h. It follows from Lemma l6.ll that we can write h in 
the form 

h{xA,XB) = {hA{xA,XB),hBixB)), 

where /iA : x ^ and Hb-.R^ ^ are convex monotone posi- 
tively homogeneous maps. Due to the this form we have that {h^)B = {^b)^ 
and {h^)^ = {h^)^ , where /i^ : is given by h^{xA) = hA{xA,^)- 

This implies that ^^((/i^)'^) = G''{h''). 

By Proposition 16.21 there exists 7;^ in such that h^{yA) = va- 
Let W be the \A\ x [^| diagonal matrix with Wu = {vA)i for all i A. Now 
define 5: ^ by 




that = {G%g))^ for all A: > 1. 



□ 



g{x) = {W-^ oh"^ oW){x) forahxGM^. 
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Clearly ^'^((/i^)*^) = G^ig^) for all k > 1. Moreover, 5(0) = and 5(1) = 1. 
so that 

g{x + Xl) < g{x) + Xl 

for all X € M"^ and A > 0, as (7 is convex and positively homogeneous. By 
Corollarv 18.31 we get that Q'^{g^) = {G^{g))^ for all k > 1. From this it 
follows that 

g%h') = g^ih'^)'') = g%g') = (g^g))'' = {g%h'^)f = {g%h))\ 

which completes the proof. □ 

By using Proposition 18.41 it is now easy to prove Theorem 18.11 

Proof of Theorem \8.1\ Let / : P — )■ P be a convex monotone map with a 
t-stable fixed point v € V. Then is a t-stable fixed point of For each 
k>lwe have that df^{v) = d{f^y^{0), so that 

g-(fk) = g-{df\v)) = g'{d{f'y.M) = g\{f%). 

Thus, it follows from Proposition 18.41 that 

g'ih = g'iifX) = g'iu'.f) = {g'u'v)? = {g'if))" 

for each A; > 1, and we are done. □ 

To analyse the periods of t-stable periodic points we need to recall the 
notion of cyclicity of a graph. The cyclicity of a strongly connected directed 
graph g, denoted c{g), is the greatest common divisor of the lengths of its 
circuits. The cyclicity of a general directed graph g is given by, 

c{g) = lcm{c(t/i): gi is a strongly connected component of g}. 

The cyclicity of a nonnegative stable matrix P is defined by c{P) = c{g'^{P)). 
Note that c{P) is the order of a permutation on n letters, where n is the size 
of the matrix. The following consequence of the Perron-Frobenius theorem 
concerning the cyclicity of stable nonnegative matrices can be found in [20\ 
Theorem 9.1]. 

Theorem 8.5 ([20]). If P is stable nonnegative matrix, then the period of 
each periodic point of P divides c{P). 

For a convex monotone map f : V V with a t-stable fixed point, we 
define the cyclicity of f by c(/) = c{g^[f)). 
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Theorem 8.6. IfV C M" is downward and f : D ^ T> is a convex monotone 
map with a t-stahle fixed point, then the period of each t-stable periodic point 
of f divides c{f). In particular, the period of each t-stable periodic point is 
the order of a permutation on n letters. 

Proof. Let v & V he a t-stable fixed point of / and let ^ G P be a t-stable 
periodic point of / with period p. Put g = f^^f^ and note that c{g) = 1. 
Indeed, by Theorem O we get that g^{g) = G^{f<f^) = {g^{f)Y^^^ = 
U|=i^j , where Gi, ■ ■ ■ ,Qs are the disjoint strongly connected components 
of Q'^{f). Let Ci = c{Qi) for 1 < i < s and note that q divides c(/). It 
well-known that if Qi is a strongly connected graph with cyclicity Cj, then 
c{Q^'^^) = 1 for all A: > 1 (see [3 Section 2]). In particular, we get that 

c{gf-^'') = 1 for all 1 < i < s. Thus, 

c{g) = ciuUgf^'^) = 1cm {c{gf^^) : 1 < i < s} = 1. 

By Theorem 14.61 there exists M G dg{v) such that g'^{M) = g^{g), so 
c(M) = c{g) = 1. Now let C, D, U, and / as in Proposition 14.31 As g{v) = v 
and g{x) — g{v) > M[x — v) for all x G we get that 

g^{x) > M^{x -v)+v for ah x G P and A; > 1. (33) 

In particular, 

e = g^iO > M^{i -v) + v, (34) 

so that i-v> MP{^ - v). It follows that ^-v = MP{^ - v) on C U D and 
S^ — V = on D from Proposition 14.41 This implies that gP{£,) > ^ on CU D. 

Put F = CU D and G = UUl. By definition we have that Mpc = 0, 
and so M^q = for all /c > 1. Prom this we deduce that 

(^ - v)f = {MP{i - v))f = {MffYH - v)f = Mlp{i - v)f. 

The matrix M is stable and has cyclicity one. Therefore the matrix Mff 
is also stable and has cyclicity one. This implies that any periodic point of 
Mff must have period one by Theorem 18.51 Thus, we find that {£, — v)f = 
Mff{^-v)f, so that {S,-v)f = M^p{^-v)f for aU A; > 1. Since Mfg = 
we deduce that 

{i-v) = M^{i-v) onF. 

From (IMD it follows that g^{i) > ^ on F. Let z = ^Ag{^) A ... A gP'~'^{0- 
Clearly z < ^ and z = ^ on F. As g{z) < z, it follows from Lemma 17.21 that 
g'^{z) = Ymi}^^^ g^ {z) exists and g'^{z) = z on C. Thus, g'^{z) = ^ on C . 



32 



Note that g^{z) and ^ are fixed points of , and ^ is a t-stable fixed point 
of = fP^^f\ Tlierefore it follows from Lemma 15.21 that g^{z) > ^. As 
g'^iz) < z <^,we conclude that g'^{z) = z = ^. Hence T^-^^O = 5(0 = ^ 
from which we conclude that the period of ^ divides c(/). □ 

Remark that if / is strongly monotone convex map with a t-stable fixed 
point V & "D, then every P G df{v) is positive by Proposition 12.21 Hence 
c(/) = 1 in that case, and therefore / has no t-stable periodic points except 
its t-stable fixed points. We also like to point out that in Theorem 18.61 the 
t-stability assumptions are essential. Indeed, consider 



A = I — sin a cos a I and P 




1 





1 





1 


1 


—a 


—a 


1 



then 

/ 1 ab b-1 

B = PAP-^ ~ a(6 - 2) 1 6-1 

V q(6- 1) q(6- 1) b 

when a > is sufficiently small. Thus, for 6 > 2, the matrix B is nonnegative 
for all sufficiently small a > 0. Now if a = I'k jp^ then A has a periodic point 
of period p and hence B has one too. This shows that a monotone convex 
map may have (unstable) periodic orbits with arbitrary large periods. We 
also remark that if a > is an irrational multiple of vr, then B has an 
unstable bounded orbit that does not converge to a periodic orbit. 



9 Global convergence and non-expansiveness 

In this final section we give a condition under which every orbit of a convex 
monotone map /: D ^ V, where P = M", converges to a Lyapunov stable 
periodic orbit. To present it we need the notion of the recession map f of 
/, which can be defined by 

f{x) = lim \f{Xx) for all x G M'^. 

A— >oo A 

Since /: R" — > is convex, /(x) e (M U {cjo})" exists for each x G M" and 
is equal to 

fix) = sup f{y + x) - f{y) (35) 

(see \25\ Theorem 8.2]). As / is the point- wise limit of a convex monotone 
map, / is also convex and monotone. The next theorem shows that if / has 
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all its orbits bounded from above, then / is non-expansive with respect to 
a polyhedral norm. 

Theorem 9.1. ///: M" M" is a convex monotone map and the recession 
map f has all its orbits bounded from above, then f is non-expansive with 
respect to the norm \\ ■ ||^ given in Theorem 1 6. 51 

Proof. We remark that / is a convex, monotone, and positively homogeneous 
map, which has as a t-stable fixed point, because (/)q = / and / has all 
its orbits bounded from above. Moreover, 

- f{-x) < f{y + x)- f{y) < fix) (36) 

for all X G M" by ([35]). 

Let II • \\v be the polyhedral norm from Theorem 16.51 and remark that / 
is non-expansive with respect to || • ||„. Clearly ||ti||„ < \\w\\y ii u,w £ M" 
are such that < |n| < \w\, where |2;| = {\zi\. . . . , \zn\)- Therefore it follows 
from ()36p that 

ll/(y + ^)-/(2/)l|. <max{||/(-x)||„||/(x)||4< ||x||, 

for all x,y M". Thus, / is also non-expansive with respect to |[ • ||t,. □ 

This theorem has the following consequence. 

Corollary 9.2. ///: M" — )• is a convex monotone map and f is non- 
expansive with respect to some norm on M", then f is non-expansive with 
respect to a polyhedral norm. 

Proof. We note that f{x) = limA^-oo /(A2;)/A for all x G M". As / is non- 
expansive with respect to some norm, / will be non-expansive with respect 
to the same norm. This implies that / has all its orbits bounded from above, 
since /(O) = 0. From Theorem I9.1l we conclude that / is non-expansive with 
respect to a polyhedral norm. □ 

It is proved in [22] that if a map /: M" — t- is non-expansive with 
respect to a polyhedral norm, that every bounded orbit of / converges to 
a periodic orbit. Moreover, if the unit ball of the polyhedral norm has N 
facets, then the period of each periodic point of a non-expansive map does 
not exceed max^ 2^' ( ^^^^-1 ) , see [18]. By using these results, the following 
global convergence theorem can be proved. 
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Theorem 9.3. // /: M" — )> M" is a convex monotone map, with a fixed 
point, and the recession map f has all its orbit bounded from above, then 
every orbit of f converges to a Lyapunov stable periodic orbit of f whose 
period divides c{f). 

Proof. As / has all its orbits bounded from above, we know by Theorem 
19.11 that / is non-expansive with respect to a polyhedral norm, so that all 
periodic orbits of / are Lyapunov stable. Since / has a fixed point, it follows 
from [22] that every orbit of / converges to a periodic orbit. Proposition 
13.21 implies that every periodic point of / is t-stable, and hence the period 
of each periodic point divides c(/) by Theorem 18.61 which completes the 
proof. □ 
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